Method for implementing a quantizer in a multimedia compression and encoding system

ABSTRACT

Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.

RELATED APPLICATIONS

This application claims the benefit under title 35, United States Code,Section 119(e) of the U.S. provisional application having Ser. No.60/395,971 that was filed on Jul. 15, 2002.

FIELD OF THE INVENTION

The present invention relates to the field of multimedia compressionsystems. In particular the present invention discloses methods andsystems for implementing a quantizer that efficiently selects aquantizer value for each macroblock that will obtain a high compressionratio without sacrificing video image quality.

BACKGROUND OF THE INVENTION

Digital based electronic media formats are finally on the cusp oflargely replacing all of the older analog electronic media formats. Inthe audio media arena, digital compact discs (CDs) replaced analog vinylrecords long ago. Analog magnetic cassette tapes are becomingincreasingly rare and will eventually share the same fate of 8-tracktapes. Second and third generation digital audio systems such as digitalMini-discs and MP3 (MPEG Audio—layer 3) files are now taking marketshare away from the first generation digital audio format of compactdiscs.

The video media has been slower to move from analog storage andtransmission formats to digital storage and transmission formats thanaudio. The reason for this slower analog to digital transition islargely due to the massive amounts of digital information required toaccurately represent video images in digital form. The massive amountsof information require very high-capacity digital storage systems withhigh bit-rate outputs and high-bandwidth transmission systems.Furthermore, cost of switching from analog video equipment to digitalvideo equipment is significantly higher than the cost of switching fromanalog audio equipment to digital audio equipment.

However, video is now finally rapidly moving from analog storage (VHSand Beta) and analog transmission formats (NTSC and PAL) to digitalstorage (MPEG) and digital transmission formats (ATSC). The DVD (DigitalVersatile Disc), a digital video system, has been one of the fastestselling consumer electronic products in years. DVDs have been rapidlysupplanting VHS and Beta Video-Cassette Recorders (VCRs) as thepre-recorded video playback system of choice due their high videoquality, very high audio quality, convenience, and extra features. A newgeneration of intelligent Personal Video Records (PVRs) such as TiVo andReplay have emerged that take advantage of digital video technology. Theantiquated analog NTSC (National Television Standards Committee) videotransmission system is now being replaced with the digital ATSC(Advanced Television Standards Committee) video transmission system thatprovides for 5.1 channels of CD-quality digital audio and beautifulhigh-definition television (HDTV) images.

Computer systems have been using various different digital video storageand transmission formats for a number of years. Among the best digitalvideo compression and encoding systems used by computer systems havebeen the series of digital video encoding systems backed by the MotionPictures Expert Group, better known as MPEG. The three most well knownand widely used digital video encoding systems from MPEG are knownsimply as MPEG-1, MPEG-2, and MPEG-4. VideoCDs and consumer-gradedigital video editing systems use the MPEG-1 format. Digital VersatileDiscs (DVDs), the Dish Network brand direct broadcast satellite (DBS)television system, and the new terrestrial digital transmission systemknown as ATSC use the MPEG-2 digital video compression and encodingsystem. MPEG-4 system was originally developed for small mobile devices.However technology from the MPEG-4 system is rapidly being adapted bynew computer based digital video encoders and digital video players.

The MPEG-2 and MPEG-4 standards compress a series of video frames andencode the compressed frames into a digital bit stream. When encoding avideo frame with the MPEG-2 and MPEG-4 systems, the video frame isdivided into a rectangular grid of macroblocks. Each macroblock in thevideo frame is independently compressed and encoded.

When compressing the macroblocks from a video frame, an MPEG-2 or MPEG-4encoder uses a quantizer that selects a quantizer value (q) that is usedto quantize individual numeric values in the macroblock. The smaller thequantizer value (q), the more bits will be used to encoded themacroblock. In order to efficiently compress macroblocks from a videoframe, the quantizer in a digital video encoding system must be able toselect an appropriate a quantizer value (q) that maximizes thecompression while ensuring a high quality compressed video frame.

SUMMARY OF THE INVENTION

Method For Implementing A Quantizer In A Multimedia Compression AndEncoding System is disclosed. In the Quantizer system of the presentinvention, several new quantization ideas are disclosed. In oneembodiment, macroblocks are grouped together into macroblock groups. Themacroblock groups are then assigned a common quantizer value. The commonquantizer value may be selected based upon how the macroblocks areencoded, the type of macroblocks within the macroblock group(intra-blocks or inter-blocks), the history of the motion vectorsassociated with the macroblocks in the macroblock group, the residualsof the macroblocks in the macroblock group, and the energy of themacroblocks in the macroblock group. The quantizer value may be adjustedin a manner that is dependent on the current quantizer value.Specifically, if the quantizer value is at the low end of the quantizerscale, then only small adjustments are made. If the quantizer value isat the high end then larger adjustments may be made to the quantizer.Finally, in one embodiment, the quantizer is implemented along with aninverse quantizer for efficient operation.

Other objects, features, and advantages of present invention will beapparent from the company drawings and from the following detaileddescription.

BRIEF DESCRIPTION OF THE DRAWINGS

The objects, features, and advantages of the present invention will beapparent to one skilled in the art, in view of the following detaileddescription in which:

FIG. 1 illustrates a block diagram of a digital video encoder.

FIG. 2 a illustrates a video frame that has been divided into a matrixof macroblocks.

FIG. 2 b illustrates the video frame of FIG. 2 a wherein all themacroblocks from the same row have been placed into a macroblock group.

FIG. 2 c illustrates the video frame of FIG. 2 a wherein all themacroblocks have been divided into macroblock groups containing twomacroblocks in each macroblock group.

FIG. 3 illustrates a one dimensional line graph with a set ofquantization categories centered on an average of the macroblock groupSAD values.

FIG. 4 illustrates graph that maps quantizer value to bytes permacroblock.

FIG. 5 illustrates a block diagram of a digital video encoder systemwith an integrated quantizer and inverse quantizer.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

A method and system for performing rate control in a multi-mediacompression and encoding system is disclosed. In the followingdescription, for purposes of explanation, specific nomenclature is setforth to provide a thorough understanding of the present invention.However, it will be apparent to one skilled in the art that thesespecific details are not required in order to practice the presentinvention. For example, the present invention has been described withreference to the MPEG-4 multimedia compression and encoding system.However, the same techniques can easily be applied to other types ofcompression and encoding systems.

Multimedia Compression and Encoding Overview

FIG. 1 illustrates a high-level block diagram of a typical digital videoencoder 100 as is well known in the art of digital video. The digitalvideo encoder 100 receives incoming stream of video frames 105 at theleft of the block diagram. Each incoming video frame is processed by aDiscrete Cosine Transformation (DCT) unit 110. The frame may beprocessed independently (an intra-frame) or with reference toinformation from other frames received from the motion compensation unit150 (an inter-frame).

Next, a Quantizer (Q) unit 120 quantizes the digital video informationfrom the Discrete Cosine Transformation unit 110. Finally, the quantizedframe information is then encoded with an entropy encoder (H) unit 180to produce a final encoded bit stream.

Since an inter-frame encoded video frame is defined with reference toother nearby video frames, the digital video encoder 100 needs to createa copy of how each digital video frame will appear within a digitalvideo decoder such that inter-frames may be encoded. Thus the lowerportion of the digital video encoder 100 is essentially the same as adigital video decoder unit. Specifically, an Inverse quantizer (Q⁻¹) 130first reverses the quantization of the frame information. Next, aninverse Discrete Cosine. Transformation (DCT⁻¹) unit 140 reverses theDiscrete Cosine Transformation of the frame information. After all theDCT coefficients are reconstructed from iDCT, the motion compensationunit will use the information, along with the motion vectors, toreconstruct the video frame. The reconstructed video frame may then beused as a reference frame for the motion estimation of other videoframes.

The reconstructed video frame may then be used to encode inter-framesthat are defined relative to information in the reconstructed videoframe. Specifically, a motion compensation (MC) unit 150 and a motionestimation (ME) unit 160 are used to determine motion vectors andgenerate differential values used to encode inter-frames based upon thereconstructed video frame.

A rate controller 190 in a digital video encoder 100 receivesinformation from many different components of the digital video encoder100. The rate controller 190 uses the information to allocate a hitbudget for each video frame to be encoded. The bit budget should beallocated in a manner that will generate the highest quality digitalvideo bit stream that that complies with a specified set ofrestrictions. Specifically, the rate controller 190 attempts generatethe highest quality compressed video stream without overflowing buffersof a digital video decoding unit (exceeding the amount of availablememory by sending more information than can be stored) or underflowingbuffers (not sending frames fast enough such that the digital videodecoding unit runs out of video frames to display).

Macroblocks and Quantization

In MPEG-2 and MPEG-4 video encoding systems, the video frame is dividedinto a rectangular grid of ‘macroblocks’ wherein each macroblockrepresents a small rectangular area of the video frame. FIG. 2 aillustrates a video frame that has been divided into a matrix ofmacroblocks. In an MPEG-4 video encoding systems, the macroblocks eachcontain a 16×16 matrix of pixels. The macroblocks in FIG. 2 a aresequentially numbered starting from the upper left corner and scanningacross horizontally and then down to the next sequential row.

As set forth in the previous section, the macroblocks in a MPEG-4 systemare first processed by a Discrete Cosine Transform (DCT) unit 110. Next,the results from the Discrete Cosine Transform (DCT) unit 110 are thenquantized by a Quantizer unit 120 to reduce the amount of informationneeded to represent the macroblock. The Quantizer unit 120 selects aquantizer value (q) that will be used to quantize a particularmacroblock.

In some digital video encoding systems, the quantizer value (q) used fora particular macroblock can only change a very limited amount from thequantizer value (q) used by the previous adjacent macroblock.Specifically, in MPEG-4, the quantizer value (q) for a macroblock canonly change from the quantizer value (q) of the immediate precedingmacroblock by a difference in the range of −2, −1, 0, +1, or +2.

Quantization for Macroblock Groups

In one embodiment of the present invention, the quantizer arranges themacroblocks into groups to use a single group quantizer. Specifically,all the macroblocks within the same ‘macroblock group’ are encoded withthe same quantizer value (q). In this manner, the quantizer value doesnot vary so quickly across the image. Instead, the macroblock groupingwill cause a more steady change across the image. If the macroblockswere not grouped, then a significant quality change might not be seensince the quantizer value may instead react incorrectly to localphenomenon.

In digital video encoding schemes such as MPEG-4, the quantizer valuesare only allowed to change by small amounts between adjacentmacroblocks. Thus, for such digital video encoders it is important tocorrectly group the macroblocks to allow the quantizer values to step upor step down to the desired quantizer values.

FIG. 2 b illustrates the video frame of FIG. 2 a wherein all themacroblocks from the same macroblock row have been placed into amacroblock group. Each macroblock row group has been given a number from0 to 6 as illustrated in FIG. 2 b. In one embodiment, all of themacroblocks in the macroblock group are given the same quantizer value.

Macroblock Group Quantizer Assignment Using Mean Residual/SAD

One method of selecting a quantizer value for an individual macroblockis to examine information from the Motion Estimator unit 160.Specifically, a residual that can be measured as a sum of absolutedifferences (SAD) value for the macroblock calculated by the MotionEstimator unit 160 may be used to select a quantizer value (q). Forexample, macroblocks with large SAD values (a complex macroblock with alarge residual) will receive a finer quantizer value that does notcompress the macroblock excessively. Similarly, macroblocks having asmall SAD value (a simple macroblock) receive a coarser quantizer value(q) to efficiently compress such simple macroblocks. To select aquantizer value (q) for a group of macroblocks, the SAD values areaveraged together to provide a mean sum of absolute differences referredto as m_(g) (where g specifies the macroblock group number 0 to 6). Asillustrated in FIG. 2 b, the mean sum of absolute difference value forthe first row grouping of macroblocks (m₀) is calculated by averagingthe SAD values s₀ to s₉ for that row with the formula

$m_{0} = {\frac{1}{9}{\sum\limits_{i = 0}^{9}\; {s_{i}.}}}$

Macroblock Group Quantizer Assignment Using Mean Macroblock Energy

Another method of selecting a quantizer value for an individualmacroblock is to examine the energy information for the macroblock. The‘energy’ of a macroblock is a measure of the frequency of the data. Amacroblock with high frequency data (thus high ‘energy’ data) should beallocated more bits by assigning a coarse quantization value. The energymeasure may be viewed as an estimate of how much quantization noise aparticular macroblock holds. Thus a high energy macroblock is determinedto have an ability to hold quantization noise such that a coarsequantizer value should be used. Conversely, a macroblock with low energyand thus less ability to hold quantization noise should be given a finerquantizer value. To select a quantizer value (q) for a group ofmacroblocks, the energy values for the macroblocks may be averagedtogether to provide a mean energy value. The mean energy value may thenbe used to select a quantization value for the macroblock group.

Macroblock Group Quantizer Assignment Quantizer Categories

In another implementation, the various different macroblock groups maybe assigned into limited number of different quantization categories. Togenerate a set of quantization categories, one of the macroblock groupmeasurements may be used to divide the various macroblock groups intodifferent categories. For example, the mean macroblock residual/SADvalue or the mean macroblock energy may be used.

To provide an illustration of different quantization categories, oneimplementation using mean SAD values is hereby presented. First, thevarious different mean SAD values m₀ to m₆ for each macroblock groupsare plotted on line. Then an average of the macroblock group SAD valuesis calculated as follows:

$m_{AVG} = {\frac{1}{7}{\sum\limits_{i = 0}^{6}\; m_{i}}}$

The macroblock group SAD values and the overall macroblock group averageare plotted on the same line as illustrated in FIG. 3. Finally, a set ofquantization categories are then centered about the m_(AVG) value, theaverage of the macroblock group SAD values.

In the example embodiment of FIG. 3, there are only three differentquantization categories (q_(Easy), q_(Normal), and q_(Hard)). Thus, asillustrated in FIG. 3, q_(Normal) is centered on the m_(AVG) value,q_(easy), lies to the left of it for handling this simple macroblockgroups with small SAD values, and q_(Hard) lies to the right forhandling complex macroblock groups with high SAD values. Although FIG. 3illustrates an example with only three quantization categories, therecould be many more quantization categories. Similarly, the quantizationcategorization may be performed with macroblock group energy values orany other macroblock group measurement.

Advanced Macroblock Groups for Quantization

In a more advance embodiment of the present invention, the quantizer maydynamically create different sized macroblock groups. For example, FIG.2 c illustrates an embodiment wherein the macroblocks are placed intomacroblock groups of two macroblocks each. In MPEG-4 implementations forthin-client systems, the macroblocks in a macroblock group should beadjacent to each other since the quantizer changes on a relative basis.In other digital video encoding systems, the grouped macroblocks do notneed to be adjacent to one another.

A number of different factors may be considered in determining themacroblock group sizes and the macroblock groupings. Differentembodiments may take in consideration different factors.

One factor that may be considered is the capabilities of the computersystem being used to run the video encoder system. The quantizer mayfirst determine the amount of CPU processing power available beforedetermining the size of the macroblock groups. The CPU processing powerincludes a processor speed, an amount of available memory, a cachememory speed, cache memory size, and other characteristics that affectcomputer performance. In this manner, the quantizer may select anoptimal macroblock group size for the particular computer system beingused.

In conjunction with the processing power of the computer system, thesize of the video frame should be used to determine the macroblockgrouping. The size of the video frame determines the number ofmacroblocks in the video frame, and therefore is another factor thatdetermines how much processing is required to encode each video frame.The reason the number of macroblock groups matter is that the digitalvideo encoder can not be allowed to exceed its allocated time forencoding one video frame. As a result, the size of macroblock groupsdepends on both the available computational resources and therequirement of being able to encode the video frame within the allowedtime.

In other embodiments, the type of video sequence may help determine themacroblock group size. Specifically, the characteristics of theindividual macroblocks may be used to determine the macroblock groupsize. The method of macroblock encoding used can help in determinemacroblock groupings. For example, it may be beneficial to grouptogether macroblocks that are encoded in the same manner. Similarly, itmay be beneficial to group together the same types of macroblocks(intra-blocks or inter-blocks). The history of motion vectors may beused to group together macroblocks. Thus, it may be efficient to grouptogether macroblocks that are experiencing the same type of motion. Theamount of ‘residual’ from macroblocks may also be used in determinemacroblock groupings. The residual is the amount of difference betweenan inter-block macroblock and the macroblock that is referred to by theinter-block's motion vector. If there is a large amount of residual toencode, this means that the digital video encoder did not find a motionvector to a closely matching macroblock. Thus, macroblocks withsimilarly large (or small) residuals may be grouped together forefficiency. Finally, ‘energy’ of a macroblock may be considered duringmacroblock grouping. The ‘energy’ is a measure of the frequency of thedata. Grouping together macroblocks with similar energy values may bebeneficial. Additional macroblock features may also be considered toimprove the macroblock groupings.

Note that the quantizer in the digital video encoder may change themacroblock groupings dynamically. For example, if the digital videoencoder determines some macroblocks in a macroblock group are verydifferent from the rest of the macroblocks in a macroblock group, thenthe digital video encoder may further divide the existing macroblockgroup into two macroblock groups: one macroblock group for the differentmacroblocks and the other macroblock group containing the remainingmacroblocks from the original macroblock group. Furthermore, if thecharacteristics of the video in the video stream change, then themacroblock groupings should be adjusted in view of the newcharacteristics.

Quantizer Assignment to a Macroblock Group

As set forth in the previous section, the selection of a quantizer foreach macroblock group may be performed with reference to the sum ofabsolute difference (SAD) values of the macroblocks in the group.However, many other factors may also be taken into consideration sincethe macroblock quantization step is one of the final steps in thecompression of a video frame such that a wealth of information isavailable. Other factors that may be considered when selecting aquantizer value (q) for macroblock groups include:

-   -   How the macroblocks are encoded—There are several different        methods of encoding macroblock information. Since some of those        encoding methods are more sensitive to quantization errors, the        type of macroblock encoding should be considered.    -   Macroblock type—When the macroblock is an intra-block or an        inter-block. In generally, an intra-block should receive a finer        quantizer value for less compression since it is not referring        to any additional outside information. Inter-blocks may be given        a coarser quantization value since additional outside        information is used.    -   Current Motion Vector—Macroblock groups having fast moving        macroblocks (macroblocks having longer motion vectors) should be        given a coarser quantizer value while macroblock groups having        slow moving macroblocks (macroblocks with shorter motion        vectors) should be given a finer quantizer value.    -   Motion Vector history—If some objects have been moving for the        last couple of video frames then there is a high probability        that there will be additional movement. Thus, since our eyes        tend to focus on moving objects and the moving area will likely        be referenced by other inter-frames, macroblocks having a recent        history of motion should use a finer quantizer for less        compression.    -   The amount of macroblock ‘residual’—If the macroblocks in a        macroblock group all have a large amount of residual to encode,        then the digital video encoder was not able find motion vectors        to closely matching macroblocks. Thus, a fine quantizer value        should be used to improve the quality of the inter-macroblocks        in a macroblock group having a high residual. Macroblock groups        having a small residual may use a coarser quantizer.    -   The ‘energy’ of macroblocks—The ‘energy’ of a macroblock is a        measure of the frequency of the data. A macroblock with high        frequency data should be allocated more bits by reducing the        quantization value. The digital video encoder may use this        energy measure to estimate how much quantization noise a        particular macroblock holds. A coarse quantizer value should be        used if a macroblock is determined to have an ability to hold        quantization noise (it has high energy). Being able to hold        quantization noise means that the digital encoder may use a        coarser quantizer value but the subject quality of the video        remains the same. Conversely, a macroblock group contain        macroblocks with a small amount of energy should be given a        finer quantizer value.

Limiting the Quantizer Range

In the MPEG-4 video compression system, changes in the value of themacroblock quantizer (q) does not linearly affect the number of bitsthat will be assigned to the macroblock. Specifically, small changes atthe low end of the quantizer scale will cause large changes in thenumber of bits allocated to the macroblock, but larger changes at thehigh end of the quantizer value scale tend to change the number of bitsvery little.

This non-linear sizing effect created by the quantizer value isillustrated in the graph of FIG. 4 wherein the quantizer value q isplotted against the corresponding number of bytes that will be allocatedto the macroblock for that quantizer value q. As illustrated on the leftportion of FIG. 4, the number of bytes allocated to macroblocks at thelow end of the quantizer scale changes by a significant amount 410 asthe quantizer value changes. Conversely, the number of bytes allocatedto a macroblock changes by only a small amount 430 as the quantizervalue changes near the high end of the quantizer scale.

In one embodiment of the present invention, the quantizer takesadvantage of this peculiarity by only changing the quantizer value (q)by small increments when the quantizer is at the low end of thequantizer scale. Similarly, the quantizer makes larger changes in thequantizer at the high end of the quantizer scale.

Note that FIG. 4 is specific to an MPEG-4 compression system. Otherquantizers may exhibit different behavior but the concept of limitinghow the quantizer value is adjusted based upon the current value ofquantizer may be used in many different digital compression systems.

Integrated Quantizer and Inverse Quantizer

In one embodiment of the present invention, the video encoder isimplemented with the quantizer and inverse quantizer integrated into asingle unit. Specifically, FIG. 5 illustrates a block diagram of adigital video encoder wherein a Quantizer unit (Q) 520 has beenimplemented in the same single unit 525 as an Inverse Quantizer unit(Q⁻¹) 530.

The integration of both the Quantizer unit (Q) 520 and the InverseQuantizer unit (Q⁻¹) 530 into a single unit has allowed for veryefficient operation of both the Quantizer unit (Q) 520 and the InverseQuantizer unit (Q⁻¹) 530. The highly efficient operation is obtainedsince the data required for the operation of Inverse Quantizer unit(Q⁻¹) 530 remains in the L1 or L2 cache of the processor from theearlier processing by the Quantizer unit (Q) 520.

In a preferred embodiment, the Quantizer unit (Q) 520 and the InverseQuantizer unit (Q⁻¹) 530 are so tightly integrated that informationneeded for the inverse quantization remains in a processor register fromthe earlier quantization. In this manner, the inverse quantization isextremely efficient since it does not have to access external memory. Ina preferred implementation, the combined Quantizer and Inverse Quantizerunit performs only one computation of the absolute value instead of twoseparate computations, only one computation of the sign of the valueinstead of two separate computations, and only one load from memoryinstead of two separate loads. These changes result in a significantperformance gain is in the vector implementation where the removal justone computer instruction provides a greater impact on total instructioncount than in the scalar implementation.

The following pseudo-code examples illustrate how an integratedQuantizer and Inverse Quantizer system implemented according to theteachings of the present invention differs from prior artimplementations. In a standard prior art approach, the Quantizer andInverse Quantizer are implemented separately:

// Quantize For each row  {   vecRegister1 <--vecLoadOneRow(memoryLocation1[row]);   vecRegister2 <--vecComputeSign(vecRegister1);   vecRegister1 <--vecComputeAbsValue(vecRegister1);   vecRegister1 <--vecQuantize(vecRegister1);   vecRegister1 <--vecMultiplyTheSignBackIn(vecRegister1, vecRegister2);  memLocation2[row]<-- vecStore(vecRegister1);  } // Additionalprocessing happens in between that does // not affect memLocation2, butmay cause memLocation2 to // be moved out of processor proximity(register or cache). // Inverse Quantize For each row  {   vecRegister1<-- vecLoadOneRow(memLocation2[row]);   vecRegister2 <--vecComputeSign(vecRegister1);   vecRegister1 <--vecComputeAbsValue(vecRegister1);   vecRegister1 <--vecInverseQuantize(vecRegister1);   vecRegister1 <--vecMultiplyTheSignBackIn(vecRegister1, vecRegister2);  memLocation3[row] <-- vecStore(vecRegister1);  }

As set forth in the preceding pseudocode, the inverse quantizer stores avalue into memory that must be later reloaded by the inverse quantizers.The following pseudo-code illustrates an example implementation of anintegrated Quantizer and Inverse Quantizer system according to theteachings of the present invention.

// Integrated Quantize and Inverse Quantize For each row {  vecRegister1 <-- vecLoadOneRow(row);   vecRegister2 <--vecComputeSign(vecRegister1);   vecRegister1 <--vecComputeAbsValue(vecRegister1);   vecRegister1 <--vecQuantize(vecRegister1); //Begin the inverse quantization while valuein register   vecRegister3 <-- vecInverseQuantize(vecRegister1); //Complete the Quantization   vecRegister1 <--vecMultiplyTheSignBackIn(vecRegister1, vecRegister2); // Complete theInverse Quantization   vecRegister3 <--vecMultiplyTheSignBackIn(vecRegister3, vecRegister2);  memLocation1[row] <-- vecStore(vecRegister1);   memLocation2[row] <--vecStore(vecRegister3); }

In the preceding pseudocode of the present invention, the inversequantizer begins the inverse quantization while needed information stillresides in processor registers. Thus, the integrated quantizer andinverse quantizer of the present invention presented in the precedingpseudocode provides a great performance enhancement over the prior artdigital video encoder systems with a separated quantizer and inversequantizer.

The foregoing has described a system for performing quantization in amultimedia compression and encoding system. It is contemplated thatchanges and modifications may be made by one of ordinary skill in theart, to the materials and arrangements of elements of the presentinvention without departing from the scope of the invention.

1-33. (canceled)
 34. A method of de-quantizing a digital video framecomprising a plurality of blocks of pixels, said method comprising:dividing the video frame into more than one groups of blocks, each ofsaid groups comprising one or more of said blocks of pixels; and foreach group of blocks, assigning a same single quantizer value to allblocks in the group, wherein said single quantizer value for the groupis dependent upon how blocks in said group of blocks are encoded; andfor each group of blocks, de-quantizing the blocks in the group by usingthe same single assigned quantizer value.
 35. The method of claim 34,wherein the blocks of pixels in each group are adjacent.
 36. The methodof claim 34, wherein a number of blocks in each group is dependent on aframe size of said video frame.
 37. The method of claim 34, wherein saidsingle quantizer value for a particular group of blocks is furtherdependent upon whether said particular group of blocks contains onlyintra-blocks, only inter-blocks, or both intra-blocks and inter-blocks.38. The method of claim 34, wherein said single quantizer value for aparticular group of blocks is further dependent upon current motionvectors associated with the blocks of pixels in said particular group.39. The method of claim 34, wherein said single quantizer value for aparticular group of blocks is further dependent upon residual values forthe blocks of pixels in said particular group.
 40. The method of claim34, wherein said single quantizer value for a particular group of blocksis further dependent upon energy values for the blocks of pixels in saidparticular group of blocks.
 41. The method of claim 40 wherein saidenergy values for the blocks of pixels in said particular group ofblocks comprise frequency content of the blocks of pixels in saidparticular group of blocks.
 42. A method of quantizing a sequence ofvideo frames comprising first and second video frames, each frame in thesequence comprising a plurality of blocks of pixels, said methodcomprising: dividing the first video frame into a first set of groups ofblocks, each group in said first set of groups comprising one or more ofsaid blocks of pixels; for each group of blocks in said first set ofgroups, assigning a same single quantizer value for all blocks in thegroup and de-quantizing the blocks of pixels in the group by using thesame single assigned quantizer value; dividing the second video frameinto a second set of groups of blocks, each group in said second set ofgroups comprising one or more of said blocks of pixels, said second setof groups having different number of groups than said first set ofgroups; for each group of blocks in said second set of groups, assigninga same single quantizer value for all blocks in the group andde-quantizing the blocks of pixels in the group by using the same singleassigned quantizer value.
 43. The method of claim 42, wherein the blocksof pixels in each group of blocks in each set of groups of blocks areadjacent.
 44. The method of claim 42, wherein the blocks of pixels ineach group are adjacent.
 45. The method of claim 42, wherein a number ofblocks in each group is dependent on a frame size of said video frame.46. The method of claim 42, wherein said single quantizer value for aparticular group of blocks is further dependent upon whether saidparticular group of blocks contains only intra-blocks, onlyinter-blocks, or both intra-blocks and inter-blocks.
 47. A method ofdecoding a video picture that comprises a plurality of pixel sets, eachpixel set comprising a plurality of pixels, the method comprising: foreach video picture, grouping the plurality of pixel sets into one ormore groups, each of said groups comprising one or more pixel sets, atleast one of said groups comprising more than one pixel set, wherein anumber of said pixel sets in each group is dynamically determined duringthe decoding of the video picture; for each group of pixel sets,assigning a same single quantizer value to all pixel sets in the group;and for each group of pixel sets, de-quantizing the pixel sets in thegroup by using the same single assigned quantizer value for each pixelset in the group.
 48. The method of claim 47, wherein the number ofpixel sets in a particular group is based on a history of motion vectorsassociated with pixel sets in said particular group.
 49. The method ofclaim 47, wherein the number of pixel sets in a particular group isbased on current motion vectors associated with pixel sets in saidparticular group.
 50. The method of claim 47, wherein the number ofpixel sets in a particular group is based on an amount of encodingresidual from the pixel sets in said particular group.
 51. The method ofclaim 47, wherein the number of pixel sets in a particular group isbased on an energy of pixel sets in the particular group, wherein theenergy of a particular pixel set is a measure of a frequency of data inthe particular pixel set.
 52. The method of claim 47, wherein said pixelsets are macroblocks of said video picture.